SWAMP: Sparse Weight Averaging with Multiple Particles for Iterative Magnitude Pruning

Given the ever-increasing size of modern neural networks, the significance of sparse architectures has surged due to their accelerated inference speeds and minimal memory demands. When it comes to global pruning techniques, Iterative Magnitude Pruning (IMP) still stands as a state-of-the-art algorithm despite its simple nature, particularly in extremely sparse regimes. In light of the recent finding that the two successive matching IMP solutions are linearly connected without a loss barrier, we propose Sparse Weight Averaging with Multiple Particles (SWAMP), a straightforward modification of IMP that achieves performance comparable to an ensemble of two IMP solutions. For every iteration, we concurrently train multiple sparse models, referred to as particles, using different batch orders yet the same matching ticket, and then weight average such models to produce a single mask. We demonstrate that our method consistently outperforms existing baselines across different sparsities through extensive experiments on various data and neural network structures

Disruption of the astrocyte–neuron interaction is responsible for the impairments in learning and memory in 5XFAD mice: an Alzheimers disease animal model

The morphological dynamics of astrocytes are altered in the hippocampus during memory induction. Astrocyte–neuron interactions on synapses are called tripartite synapses. These control the synaptic function in the central nervous system. Astrocytes are activated in a reactive state by STAT3 phosphorylation in 5XFAD mice, an Alzheimers disease (AD) animal model. However, changes in astrocyte–neuron interactions in reactive or resting-state astrocytes during memory induction remain to be defined. Here, we investigated the time-dependent changes in astrocyte morphology and the number of astrocyte–neuron interactions in the hippocampus over the course of long-term memory formation in 5XFAD mice. Hippocampal-dependent long-term memory was induced using a contextual fear conditioning test in 5XFAD mice. The number of astrocytic processes increased in both wild-type and 5XFAD mice during memory formation. To assess astrocyte–neuron interactions in the hippocampal dentate gyrus, we counted the colocalization of glial fibrillary acidic protein and postsynaptic density protein 95 via immunofluorescence. Both groups revealed an increase in astrocyte–neuron interactions after memory induction. At 24 h after memory formation, the number of tripartite synapses returned to baseline levels in both groups. However, the total number of astrocyte–neuron interactions was significantly decreased in 5XFAD mice. Administration of Stattic, a STAT3 phosphorylation inhibitor, rescued the number of astrocyte–neuron interactions in 5XFAD mice. In conclusion, we suggest that a decreased number of astrocyte–neuron interactions may underlie memory impairment in the early stages of AD.This research was supported by the Korea Brain Research Institute (KBRI) basic research program through Korea Brain Research Institute funded by the Ministry of Science, ICT (21-BR-02-13, 21-BR-03-02 to Y.H.J.) and by the National Research Foundation of Korea (NRF) funded by the Ministry of Education, Sci‑ence and Technology (NRF-2020R1A2C1011839 awarded to H.S.K.)

Regulation of Dendritic Spine Morphogenesis by Insulin Receptor Substrate 53, a Downstream Effector of Rac1 and Cdc42 Small GTPases

The small GTPases Rac1 and Cdc42 are key regulators of the morphogenesis of actin-rich dendritic spines in neurons. However, little is known about how activated Rac1/Cdc42 regulates dendritic spines. Insulin receptor substrate 53 (IRSp53), which is highly expressed in the postsynaptic density (PSD), is known to link activated Rac1/Cdc42 to downstream effectors for actin regulation in non-neural cells. Here, we report that IRSp53 interacts with two specific members of the PSD-95 family, PSD-95 and chapsyn-110/PSD-93, in brain. An IRSp53 mutant lacking the C-terminal PSD-95-binding motif shows significant loss of synaptic localization in cultured neurons. Overexpression of IRSp53 in cultured neurons increases the density of dendritic spines but does not affect their length or width. Conversely, short-interfering RNA-mediated knock-down of IRSp53 reduces the density, length, and width of spines. In addition, the density and size of spines are decreased by a dominant-negative IRSp53 with a point mutation in the Src homology 3 (SH3) domain and a dominant-negative proline-rich region of WAVE2 (Wiskott-Aldrich syndrome protein family Verprolin-homologous protein), a downstream effector of IRSp53 that binds to the SH3 domain of IRSp53. These results suggest that PSD-95 interaction is an important determinant of synaptic IRSp53 localization and that the SH3 domain of IRSp53 links activated Rac1/Cdc42 to downstream effectors for the regulation of spine morphogenesis

Microsphere-based interferometric optical probe

Fluorescent optical probes have rapidly transformed our understanding of complex biological systems by providing specific information on biological targets in the natural living state. However, their utility is often limited by insufficient brightness, photostability, and multiplexing capacity. Here, we report a conceptually new optical probe, termed ‘reflectophore’, which is based on the spectral interference from a dielectric microsphere. Reflectophores are orders-of-magnitudes brighter than conventional fluorophores and are free from photobleaching, enabling practically unlimited readout at high fidelity. They also offer high-degree multiplexing, encoded in their optical size, which can be readily decoded through interferometric detection with nanoscale accuracy, even in turbid biological media. Furthermore, we showcase their biological applications in cellular barcoding and microenvironmental sensing of a target protein and local electric field. © The Author(s) 201